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This applicotion i s submitted in the name of the following inventor(s): 

NOV 0 7 im s ) 

^ Cilmmnhip Residence City and State 

St ephane KASRIEL France San Francisco, CA 

Th e assign e e is Fireclick. Inc., a corporation having an address at 289 Soutli Son 

Antonio Road, Loa .Altoo, CA 91022. 

TITLE OF THE INVENTION 

eejrfe ^ELTA CACHING SERVICE 

RELATED APPLICATIONS 

• This application is related to : 

U.S. Patent Application Serial No. 09/734.910. filed December 1 1 . 2000. entitled 
"Predictive Pre-download Using Normalized Network Object Identifiers" : 

• U.S. Patent Application Serial No. 60/263.247. filed January 22. 2001 . entitled 
"Server Driven Differential Cachinq-Sm4e e": and 

• U.S. Patent Application Serial No. 10/058.232. filed October 19. 2001. entitled 
"Differential Caching with Manv-to-One and One-to-Manv Mapping", all of which are 
Incorporated herein bv reference. 

BACKGROUND OF THE INVENTION 

Field of the Invention 
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The invention relates to a delta caching service, and related methods and 

systems. 

Description of Related Art 

In a system that delivers information from a server to clients who request 

that infomiation (such as a web server delivering information to a set of web clients), it 
is desirable to minimize the amount of data that is actually sent from the web server to 
the web client. Delta caching is a technique by which the server and the client 
differentiate between template information and delta information for an object to be 
delivered from the server to the client; the client maintains a copy of the template 
information and the server is therefore able to deliver the object by only sending the 
delta information. 

The web server often manages relatively large loads by dividing its tasks, 

using a load balancer, among a set of server-responders. However, differing server- 
responders might then associate different template information with objects at the 
server. One consequence is that when a client communicates with more than one 
server-responder, the template information known to the client and to the server- 
responder might differ. This is increasingly more likely as the number of server- 
responders is increased, and might result in miscommunication between a client and 
one or more of the server-responders. 
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BRIEF SUMMARY OF THE INVENTION 



The invention provides a metiiod and system capable of ensuring that 

each client can consistently communicate with one or more servers using delta caching. 
Building templates for objects at the server(s) is functionally separated from encoding 
objects for delivery to clients. One or more template-builders are logically separated 
from one or more delta-encoders. Each operates independently to perform its part of 
delta caching; template-builders build templates, while delta-encoders use those 
templates to encode objects for delta caching. 

In an aspect of the invention, template-builders also operate so that those 

clients not configured for explicit delta caching can perfomi implicit ("clientless") delta 
caching by reference to templates maintained at one or more template-builders. In an 
aspect of the invention, delta-encoders also operate so that the template information 
and the delta information for any object can be separately compressed or sent to 
clients. In one embodiment, delta-encoders operate with template-builders using a 
client-server technique. 

BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 shows a block diagram of a system including a delta caching 

service. 
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Figure 2 shows a process flow diagram of a method including a delta 

caching service. 

INCORPORATED DISCLOSURES 

Inventions d e scrib e d herein caii be u s ed in conjunction witli t e chnology doscribGcl 

in the following docum e nts: 

# U.S. Patent Application Scriol No. 09/73 ' 1,910, (ExpreoQ Mail Mailing No. EL 768 961 
028US), fil e d D e c e mber 1 1 , 2000, in th e name of Stephane KASRJEL, attorney docket num - 
ber 155. 1002.01, titled "Predictive Pr e download Using Normalized N e twork Object Idonti - 
fi e rs", and applications olctiming priority th e r e from. 

« — US Patent Application Serial No. 60/263,217, (Expr e ss Mail Mailmg No. EK 913558282US, 
filed January 22, 2001, in th e nam e of Stephane K.A.SRIEL, attorn e y dock e t numb e r 
155. 1003.01, titled "Ser\-er Driven Differential Caching", and applications claiming priority 

o U.S. Patent Application S e rial No. 10/058,232, (Express Mail Mailing No. EL 73 1 815 560 
US), filed October 19, 2001, in the nam e of St e phan e KASRJEL, attorney docket aimibor 
155.1008 .01, titl e d "Differential Caching with Many to One and One to Many Mapping", 
and applications claiming priority therefi-om. 



Tlieae documenta aie hereby incorporated by reference as if fully set fbith herein. 

m4 are s onietimes referred to herein as th e "incorporat e d disclosur e s". 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

In the description herein, a prefen-ed embodiment of the invention is 

described, including preferred process steps and data structures. Those sl^illed in the 
art would realize, after perusal of this application, that embodiments of the invention 
might be implemented using a variety of other techniques not specifically described, 
without undue experimentation or further invention, and that such other techniques 
would be within the scope and spirit of the invention. 
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155.1010.01 
Lexicography 

The following terms relate or refer to aspects of the invention or its 

embodiments. The general meaning of each of these terms is Intended to be illustrative 
and in no way limiting. 

• client, server — In general, these terms refer to devices or software elements 
operating in a client/server relationship. 

There is no particular requirement that any particular client or any particular 
server must be a single hardware device or software module. For example, in 
some embodiments, the client device or the server device might include multiple 
devices operating cooperatively (such as when networked) or might include a 
portion of one or more devices. 

In one embodiment, the client includes a personal computer, such as a 
workstation, a laptop, or a handheld computer, having a web browser disposed 
for requesting web objects from the server. In the same embodiment, the server 
includes one or more web servers, possibly coupled to a network using an 
element for distributing requests, each of which is disposed for parsing requests 
for web objects, and for providing those web objects in response thereto. The 
web objects might be deemed "static," in which case they are retrieved from a file 
system, a database, or other storage, or might be deemed "dynamic," in which 
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case they are at least partially generated by the web server In response to 
information that Is possibly time-varying. 

There is no particular requirement that any particular client or any particular 
server must be a single hardware device or software module. For example, in 
some embodiments, the client device or the server device might include multiple 
devices operating cooperatively (such as when networked) or might include a 
portion of one or more devices. 

• delta caching — In general, this refers to a technique in which a client obtains 
information regarding a web object in at least two parts: "template information," 
which refers to information that might be relatively static and is (in one 
embodiment) retained at the client, and "delta information," which refers to 
changes from the template information and is (in one embodiment) provided by 
the server in response to a difference between a present value of the web object 
and the template information. 

• delta encoder — In general, this refers to an element that computes the delta 
information, such as a difference between a present value of the web object and 
the template information. In one embodiment, the delta encoder might compress 
the delta information for delivery to the client. 
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155.1010.01 

• delta information — In general, this refers to information to be added to the 
template information to compose an entire web object. 

• encoding web object for delivery — In general, this refers to a technique in 
which template information is identified for the web object, delta information is 
computed in response to the web object and the template information, and the 
delta information is formatted (such as in an HTTP response message) for 
delivery to a requesting client. 

• implicit ("clientless") delta caching — In general, this refers to a delta caching 
technique in which delta information is formatted for delivery to a requesting 
client, and in which the formatted delta information includes program fragments 
(such as JavaScript) stimulating the client to retrieve the template information if 
that template information is not already at the client. 

• template, template information — In general, this refers to information which is 
relatively static, or information that has not changed since the last request for the 
same web object, or information retained by the client. 

• template builder — In general, this refers to an element that computes the 
template information, such as in response to a change in a web object. 
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44 5.10 10 . 0 1 

• web page, web object — In general, this refers to an object available at (or 
dynamically computed at) the server. A web object might include text, pictures, 
graphics, animation, video or other motion pictures, sound, program fragments or 
scripts, or other data. When a web object is associated with a specific URL and 
is intended for presentation by the client, it might be referred to as a web page. 

The scope and spirit of the invention is not limited to any of these 

definitions, or to specific examples mentioned therein, but is intended to include the 
most general concepts embodied by these and other terms. 
System Elements 

Figure 1 shows a block diagram of a system including a delta caching 

service. 

A system 100 includes a client 1 10, a communication network 120, a 

server 130, a delta encoder 140, and a template builder 150. 

Client 

The client 110 includes a workstation having a processor, program and 

data memory, and mass storage, and is operated by at least one user 111. In one 
embodiment, the program includes a web browser, disposed for requesting web objects 
from the server 1 30, for receiving web objects from the server 1 30, and for presenting 
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web objects to the user 111. The program and data memory and mass storage 
collectively include a client cache 112, in which the client 110 records information from 
the server 1 30 for presentation to the user 111. 

The client 1 10 is coupled to the communication networl^ 120, and is 

disposed for sending request messages 1 13 to the server 130. In one embodiment, the 
request messages 113 are formatted in a known protocol, such as HTTP (hypertext 
transfer protocol), SHTTP (secure HTTP), FTP (file transfer protocol), or a variant 
thereof. The client 1 10 is also disposed for receiving messages from other elements in 
the system 100. 

Networl< 

The network 120 includes a communication link capable of delivering 

information between thei client 110 and other elements in the system 100. In one 
embodiment, the communication network 120 includes an internet. However, in 
alternative embodiments, the network 120 may include an intranet, a LAN or WAN, a 
portion of a ATM network or PSTN or other switching network, or in general any 
elements disposed for delivery of information. 



Server 
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155.1010.01 

The server 1 30 includes at least one web server device 131. Each web 

server device 131 includes a processor, program and data memory, and mass storage. 
Each web server device 131 is disposed for receiving request messages 113, for 
retrieving (or dynamically generating) one or more web objects 132 in response thereto, 
and for formatting a response message 133 including those web objects 132. 

In one embodiment, the server 130 includes a load balancer 134 and a 

plurality of the web server devices 131. The load balancer 134 includes a processor, 
and program and data memory, and is disposed for receiving request messages 113 
and for delivering those request messages 1 1 3 to individual web server devices 131 . 
This has the effect of distributing the workload of responding to request messages 113 
across more than one web server device 131 , so the server "130 can respond with 
relatively less latency to individual request messages 113. 

The web objects 132 might be retrieved from the mass storage, in which 

case they are deemed "static," or might be dynamically generated by the server 130 
(specifically, by one of the web server devices 131 ) in response to information that 
might possibly be time-varying. For example, if the web object 132 specified by one of 
the request messages 113 includes stock quote information, the server 130 would 
dynamically generate that web object 132 in response to actual stock quotes (such as 
retrieved from a separate stock quote server). 
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155.1010.01 
Delta Encoder 



The delta encoder 140 includes a processor, program and data memory, 

and mass storage, coiiectlvely including a request interceptor 141, a request forwarder 
142, an object comparator 143, and a delta formatter 144. 

The request interceptor 141 is coupled to the network 120, and is 

disposed for intercepting request messages 1 13 that are destined for the server 130. 

The request fonwarder 142 is coupled to the network 120 and to the 

request interceptor 141, and is disposed for forwarding the intercepted request 
messages 1 13 to the server 130. 

In alternative embodiments, the server 130 might be disposed for sending 

all response messages 133 to the delta encoder 140, in which case the request 
interceptor 141 and the request forwarder 142 would not be needed. Accordingly, these 
elements might be regarded as optional. 

The object comparator 143 is coupled to the network 120, and is disposed 

for receiving response messages 133 from the server 130. The object comparator 143 
compares web objects 132 found in those response messages 133, using a set of 
template information 157 from tlie template builder 150, and generates delta information 
156. 



In one embodiment, the delta encoder 140, from time to time, sends a 



request to the template builder 150 for the template information 157, and records that 
template infonnation 157 in its memory or mass storage. The delta encoder 140 would 
therefore have the template information 157 readily available for computing the delta 
information 156. In alternative embodiments, the delta encoder 140 sends a request to 
the template builder 150 for the template information 157 in response to need for that 
information by the object comparator 143, and uses the template information 157 
relatively immediately. The delta encoder 140 would therefore have no special 
requirement for recording that template information 157 in its memory or mass storage. 



The delta formatter 144 is coupled to the network 120 and to the object 



comparator 143, and is disposed for formatting the delta information 156 for delivery to 
the client 110. The delta formatter 144 generates a response message 133 and sends 
that response message 133 to the network 120 for delivery to the client 110. 



In one embodiment, the delta formatter 144 compresses the delta 



Information 156 before packaging that information in the response message 133. 
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Template Builder 



The template builder 150 includes a processor, program and data 

memory, and mass storage, collectively including an object requestor 151, a template 
identifier 152, and a template server 153. 

The object requestor 151 operates, from time to time, to request web 

objects 132 from the server 130. The template builder 150 receives the web objects 
1 32 and records them in its memory or mass storage. 

The template identifier 152 operates, from time to time, on web objects 

132 recorded in memory or mass storage, and generates template information 157. In 
one embodiment, the template information 157 can be compressed by the template 
builder 150 for delivery to the delta encoder 140 or to the client 110. 

The template server 1 53 operates in like manner as the server 1 30, in that 

it receives request messages 113 and sends response messages 133. However, the 
template server 153 provides template information 157 instead of web objects 132 in 
response to the request messages 113. 

The template server 1 53 is available for responding to requests by the 

delta encoder 140, so the delta encoder 140 can obtain template information with which 
to compute delta information 156. 
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In alternative embodiments, the delta encoder 140 can operate to format 

the delta information 156 using program fragments such as JavaScript , as describ e d in t te 
incorporat e d disclo s ur e s . In this mode of operation, the client 110 does not need to know 
that the delta information 156 does not include the entire web object 132. Rather, when 
the client 1 10 attempts to present the web object 132 (it has only the delta information 
156), the program fragments direct it to request and receive template information 157 
from the template server 153, in like manner as it would request and receive a web 
object 132 from the server 130. Accordingly, the client 1 10 can obtain both the delta 
information 156 and the template information 157, and it can present the entire web 
object 132. 

Method of Operation 

Figure 2 shows a process flow diagram of a method including a delta 

caching service. 

A method 200 is performed by the system 100. Although the method 200 

is described serially, the flow points and steps of the method 200 can be performed by 
separate elements in conjunction or in parallel, whether asynchronously or 
synchronously, in a pipelined manner, or otherwise. There is no particular requirement 
that the method 200 must be performed in the same order in which this description lists 
flow points or steps, except where explicitly so indicated. 
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Client 

At a flow point 2 1 0, tlie client 1 1 0 is ready to request a web object 1 32 

from the server 130. 

At a step 21 1 , the client 110 sends a request message 1 13 to the server 

130. 

At a step 2 1 2, the client 1 1 0 receives a response message 1 33 from the 

delta encoder 140, including delta information 156. In one embodiment, the client 1 10 
recognizes the response message 133 as including only delta information 156, and the 
client 110 knows It must combine the delta information 156 with template information 
157 to present the entire web object 132. In alternative embodiments such as 
"clientless" delta caching, the response message 133 includes at least one program 
fragment directing the client 1 10 to obtain the template information 157 (either from its 
client cache 1 1 1 or from the template server 153). 

At a step 213, the client 110 determines if it has the requisite template 

information 157 to present the entire web object 132. If not, the client 110 proceeds 
with the step 214. If so, the client 110 proceeds with the step 215. 
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155.1010.01 

At a step 214, the client 110 requests the requisite template information 

157 from the template server 153 or the delta encoder 140. Template information 157 
can be served from both the template server 153 or the delta encoder 140 because they 
both include the template. A client 1 10 can be instructed to get the template information 
157 from either source. Serving the template information 157 from the template server 
153 is particularly advantageous in configurations in which the server 130 is not 
associated with a delta encoder 140. 

In other embodiments, a CDN (content delivery network) can be used to 

serve templates information 157. Thus, there are four possibilities: 1) the template 
builder 150 serves template information 157 directly to the client 110, (2) the delta 
encoder 140 serves template information 157 directly to the client 110, (3) the template 
builder 150 serves template information 157 to the client through a CDN and (4) the 
template builder 150 serves template information 157 to the client 110 through a CDN 
and the delta encoder 140 serves content to a CDN, which serves it to the client 1 10 

At a step 215, the client 1 1 0 combines the delta information 1 56 with 

template information 157 to present the entire web object 132. 

The client 110 returns to the flow point 21 0. 

Server 

The server 130 operates in like manner as an ordinary web server. 
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Delta Encoder 

At a flow point 220, the delta encoder 140 is ready to encode a web object 

132 for delivery to the client 110. 

At a step 221 , the object comparator 143 receives the web object 132 

from the server 130. As noted above, the delta encoder 140, from time to time, 
requests template information 157 from the template server 153, and records that 
template information 157 in its memory or mass storage. 

At a step 222, the object comparator 143 compares the web object 132 

with the template infonnation 157, and generates delta information 156. 

At a step 223, the delta formatter 144 formats the delta information 156 for 

delivery to the client 110, generates a response message 133 and sends that response 
message 133 to the network 120 for delivery to the client 110. In one embodiment, the 
delta formatter 144 compresses the delta information 156 before packaging that 
information in the response message 133. 

The delta encoder 140 returns to the flow point 220. 
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Template Builder 



At a flow point 230, the template builder 1 50 is ready to build template 

information 157. This is done the first time a web object 132 is requested and whenever 
the delta information 156 associated with that web object 132 grows "too large". 

At a step 231 , the object requestor 1 51 requests one of the web objects 

132 from the server 130. 

At a step 232, the template builder 1 50 receives the one web object 1 32 

and records it in its memory or mass storage. 

At a step 233, the template identifier 1 52 compares the one web object 

132 with an earlier version of that web object 132, and generates template information 
157 in response to the comparison. 

At an optional step 234, the template identifier 1 52 compresses the 

template information 1 57. 

The template builder 150 returns to the flow point 230. 

The template server 153 operates in like manner as an ordinary web 

server, except that it provides template information 157 instead of web objects 132. 
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Alternative Embodiments 



Although preferred embodiments are disclosed herein, many variations 

are possible which remain within the concept, scope, and spirit of the invention. These 
variations would become clear to those skilled in the art after perusal of this application. 



• The invention is generally applicable to client-server processes, and to systems 
in which clients request information and servers provide information in request to 
responses, such as for example client-server database systems and client-server 
file systems. 



Those skilled in the art will recognize, after perusal of this application, that 

these alternative embodiments are illustrative and in no way limiting. 



